THE BERNARD M. BARUCH COLLEGE 

OF 

THE CITY UNIVERSITY OF NEW YORK 
17 LEXINGTON AVENUE • NEW YORK, N. V. 10010 
. 673-7700 


DEPARTMENT OF STATISTICS 


November 30^,1971 


Allan Topol 
Covington & Burling 
8SB Sixteenth Avenue M.T’. 

Washington, D,C. 

Dear Mr". Topol: 

In accordance with your request, I have ana¬ 
lyzed the data on nicotine and tar {TPM Dry) deteiminations 
performed by the Federal Trade Commission laboratory as 
contrasted with the equivalent data produced by the 
Tobacco Industry Testing Laboratory. 

The data involved were obtained from the FTC 
laboratory summary sheets and the reports of the TITL for 
tests 5 through It is my. understanding that for brand 

cigarette's,' the samples to be tested'are picked up simul¬ 
taneously for both the FTC laboratory and TITL. Thus the 
sample cigarettes used at both laboratories are reasonably 
comparable, reflecting only the sampling variability to be 
expected within the overall sample. The analysis given 
below is based oh the validity of this assumption. 


( 1 ) 

The dates of the test were; Test 5, July 9, 1969, 
Test S, November 19, 19S9, Test 7, May 18, 1970, Test 8, 
October 21, 1970 and Test 9, August 1971. 
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I. COMPARATIVE TAR (TPM DRY) AND 
NICOTINE LEVELS 

The current test shov/ed an appreciably higher 

average tar (TPM Dry) for brand cigarettes for the FTC 

laboratory results than for the TITL determinations for 

all brands listed by both laboratories. 

Further, the last three tests have shown a 

tendency for the FTC average tar to be higher than that 

for TITL for the branded cigarettes, although previously 

( 2 ) 

in test 5 they were identical. ' 

• Average Tar (TPM Dry) 

FTC and TITL Laboratory Determinations 
For Brand Cigarettes 
Tested by Both Laboratories 
Tests 5 Through 9 


Test 

Number 

Date 

Average 
TPM Dry 
FTC - 

Tar 

,mqm 

TITL 

Difference 

Number 

of 

Brands 

5 ■ 

7/9/69 

19.558 

19.609 

+'0.051 

IIS 

6 

11/19/63 

19.132 

19.255 

+0.123 

119 

7 

5/18/70 

18.770 

18.395 

-0.375 

116 

8 

10/21/70 

18.738 

18.637 

-0.101 

118 

9 

8/71 

18.881 

18,052 

-0,829 

121 


Due to the large amount of calculations which 
would have been necessary to perform tests ox statistical 
significance for each test from 5 through 9, no tests of 
significance were performed for the difference. 
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This -tendency for the FTC tar determinations to 
run higher,than that for the -TITL is confirmed by differ¬ 
ences in average TPM Dry for the monitor cigarettes. 
However, in making the comparison, the data for the 
monitor cigarettes for test 9 cannot be compared because 
different monitor cigarettes v/ere used by the two labora¬ 
tories. In the comparable tests (5 through 8) where the 
same monitor cigarettes were used, all showed a higher 
TPM'average for the FTC laboratory determinations them 
for TITL. 

Average Tar (TPM Dry) 

For Monitor Cigarettes 
by FTC and TITL Laboratory Determinations 

N^lmber of 




Average Tar 


Determin¬ 

Type of 

Test 

TPM 

Dry 

Differ¬ 

ations 

Monitor 

Number Date 

FTC 

TITL 

ence*** 

FTC 

TITL 

FTC TITL 

5 

7/9/69 

•20.13 

19.79 

-.34** 

823 

031 

Amer Amer 

6 

11/19/69 

20.25 

20.03 

-.22** 

835 

639 

Amer Amer 

7 

5/18/70 

■ 20.59 

19.81 

-.78** 

797 

631 

Amer Amer 

8 

10/21/70 

18.52* 

18.37* 

-.15** 

832 

630 

B&W BSW 

9 

8/71 

(19.71) 

(18.13) 

* 

1138 

693 

L&M B&W 

No 

comparison 

possible 

due to 

different 

monitors 

used at 


each laboratory. 

**A11 differences statistically significant at better than 
the .01 level. 

***Negative difference indicates lower value for TITL and 
higher for ,FTC. 
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An analysis of the differences in TPM (Dry) 

determinations for the various brands disclosed that in 

the current test, the disparity increases with the level 

of tars in the cigarettes- tested, with PTC laboratory 

«• 

results producing higher levels in all.categories. 

Differences in Average TPM- - (Dry) 

FTC Laboratory and TITL Determinations 
For Brand Cigarettes 
By FTC TPM Levels 
Test Dated August 1971 Test No. 9 

Difference* FTC 

FTC and TITL Average Number 

TPM (Dry) ,mqTO TPM (Dry) , mgm . of Brands 


1 

- 16.9 

-.27 

30 

17*0 

- 19.9 

-.54 

52 

20.0 

- 22.9 

-.63 

17 

23.0 

and over 

-2.67 

22 


NOTE: Only for brands tested by both laboratories. 

*Negative differences indicate a lower average value for 
TITL and higher for. FTC. 

A statistical test^^) discloses that these dif¬ 
ferences between the averages at the different FTC TPM (Dry) 
levels is statistically significant and thus the trend is 
not an accident of sampling. 


^^^An analysis of variance test discloses that 
the variation in the average difference among the FTC 
level groups are statistically significant at better than 
.001 level. 
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This tendency for an increasing disparity 
between the FTC and TITL determinations has developed 
recently. The disparities between the average determin¬ 
ations. in prior tests are shoxra below: 

Differences in Average TPM (Dry) 

FTC Laboratory and TITL Determinations 
for .Brand Cigarettes 
By FTC TPM Levels 
Tests 5 Through 9 

Difference* FTC & TITL 

FTC Averages TPM (Dry) '• Number of Brands 


TPM Dry 
mgm 

Tests 

■ 5 6 7 

8 9 

5 

6 

Tests 

7 

8 

9 

1-16.9 

-.32 -.15 

-.47 

-.06 -.27 

25 

32 

28 

27 

30 

17.0-19.9 

+.07 +.07 

-.42 

-.05 -.54 

33 

35 

37 

45 

52 

20.0-22.9 

+.05 +.07 

-.50 

-.11 -.63 

39 

28 

30 

24 

17 

23.0 and 
over 

+.52 +.61 

.00 

-.21-2.67 

23 

24 

21 

22 

22 


*Negative difference indicates higher FTC average and lower 
TITL' average. 

♦ 

It is to be noted that no such consistent 
difference is found in the nicotine determinations by the 
. two laboratories. The average nicotine determinations for 
monitor cigarettes for the two laboratories indicate these 
inconsistent differences. 
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Average Nicotine 

FTC Laboratory and TITL Determinations 
For Monitor Cigarettes 
Tests 5 Through 9 


Number of 

Average Determln- Type of 

Test Nicotine mgmDiffer- ations Monitor 


Number Date 

PTC TITL ences* 

PTC 

TITL 

FTC 

TITL 

5 

7/9/69 

1.330 1.298 

“.032 

823 

631 

Amer 

Amer 

6 

11/19/69 

1.310 1.279 

-.031 

■ 835 

639 

Amer 

Amer 

7 

5/18/70 

1.291 1.323 

+.032 

797 

631 

Amer 

Amer 

8 

10/21/70 

1.267 1.255 

-.012 

832 

63 0 

s sw 

B&W 

9 

8/71 

1.391**1.269** 

— 

1138 

693 

L&M 

B&W_ 

*Negative difference indicates 

.higher value for FTC, 

lower 


value for TITL. 

**Not comparable since different monitor cigarettes "were 
used at each laboratory. 


Nevertheless, it is to be noted that these 
differences though small, are all statistically significant 
and not an accident of sampling. For tests (5 through 8), 
in which the same monitors were used in both laboratories, 
the overall average nicotine average for the FTC laboratory 
of 1.30Q mgm compares to the TITL laboratories average of 
1.288 mgm. 
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The TPM (Dry) value is calculated from 3 
separately determined values; TPM (Wet), Water and 
Nicotine, The water and nicotine values are subtracted 
from the TPM (Wet) to obtain the TPM (Dry). Since these 
values are established separately, a study of the dis¬ 
parities between the tx^70 laboratories for these three 
types of determinations, may disclose the reason for the 
above noted differences in TPM (Dry) values, 

It will be remembered that there is a trend in 
the interlaboratory differences in TPM (Dry) when tabulated 
by PTC values for TPM (Dry) for test 9 data. The first 
analysis attempted to establish reasons for these differences 
by contrasting the interlab disparities for determinations 
of TPM (Wet), water and nicotine separately for high "tar" 
cigarettes (23 nigm and over of TPM (Dry) - FTC values) and 
low "tar" cigarettes (1 - 16.9 mgm TPM (Dry) FTC values). 
The comparison of the averages for the two laboratories is 
given.below; 


PM3001013710 
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Average TPM(Wet), Nicotine and Water 
High and Low "Tar” Brand Cigarettes 
As Determined by PTC Laboratory and TITL 
'Test No. 9 Dated^August 1971 

PTC Average nigiti* Average mgm* Average mgm* 

TPM Dry TPM (Wet) ' Water Nicotine 

mqm FTC TITL Diff. FTC TITL.Diff. FTC TITL Diff. 


1-16.9 14-40 14.42 + .02 1-71 1.97 +-.26 .74 .77 +.03 

23 and 

over 32.69 29.50 -3.19 3-.94 3.44 -.50 1,60 1.59 +.01 

*Average mgm per cigarette. The low tar cigarettes 
included 30 brands, the high tar 22 brands. 

NOTE: Negative differences indicate a higher FTC value 
and lower TITL value. 


The outstanding comparison is in the TPM (Wet) 
values where the disparity betv^een averages for the 

tv7o laboratories differed widely for high and low "tar" 
cigarettes but showed virtually no difference for the low 
"tar" cigarettes. 

It might be expected that with higher TPM (Wet) 
averages at the FTC laboratory for high "tar" cigarettes, 
that the water determinations would tend to be higher, which 


indeed they were. For low tar cigarettes the amount of 
water vras actually .lower at the FTC laboratory. 
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However, when the water content is expressed 

as a percent of the TPM (Wet), it is seen that this water 

content is disproportionate' to;.the. TPM (Wet) values at 

the two laboratories, 

■ Relative Water Content of TPM (Wet) 

High and Low "Tar" Brand Cigarettes 
As Determined by PTC Laboratory and TITL 
Test Wo. 9 Dated August 1971 


FTC 

Water 

Content As 


TPM Dry 

Percent 

of TPM (x-Jet) 


mgra 

FTC 

TITL 

Diff. 

1 - 16.9 

11,9% 

13 .-7% 

"1.8% 

23 and 
over 

12.1% 

11.7% 

+ .4 


Thus, the difference between the two laboratories 
in TPM (Wet) for high "tar" cigarettes "is not completely 
offset by the increase in water content. 


The nicotine determinations at the two laboratories 
were very close as shovm above and have been very close 


during prior tests. 
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Average Nicotine Determinations 
As Determined FTC Laboratory and TITL 
For High "-Tar" Brand Cigarettes 


Test 5 Through 9 
Average Nicotine 

Per Cigarette mgm- No. of- 


Test 

FTC 

TITL 

Diff. 

Brands 

5 

1.68 

1.67 

-.01 

30 

6 

1.60 

■ 1.59 

-.01 

24 

7 

1.58 

1.63 

+ .05 

21 

8 

1.62 

1.63 

+ .01 

22 

9 

1.60 

1.59 

-.01 

22 


Apparently the bulk of the disparity lies in the 
greater TPM (Wet) at the FTC laboratory for high "tar" 
cigarettes. Since the TPM (Wet) is determined merely by 
subtracting the.weight of the filter before and after 
smoking, the disparity may well lie either in the operation 
of the smoking machines or the smoking conditions. 

An analysis of the average number of puffs per 
cigarette smoked for the same high and low "tar" cigarettes 
indicated that the, average number of puffs per cigarette 
was higher for TITL determinations in Test•9 than for FTC 
v?ith a greater disparity for the high "tar" cigarettes. 


PM3001013713 
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‘ Average Puffs Per Cigarette 
High and Lov7 "Tar" Brand Cigarettes 
For PTC Laboratory and TITL 
Test No. 9 Dated August 1971 


FTC 

Average Puffs 


TPM Dry 

Per 

Cigarette 


mqm 

FTC 

TITL 

-Difference 

1 - 16.9 

7. 85 

8.10 

+ . 25 

23 and 




over 

9.18 

9.59 

+, 4 X 

This 

finding is 

reinforced by 

the fact that for 

all 30 brands 

of low "far 

" cigarettes and all 24 brands 

of high "tar" 

cigarettes, 

the average number of puffs for 

every brand was higher at 

TITL than at 

the FTC laboratory 


This established the statistical significance of the 
differences in average puffs without questionJ 

Among other possible reasons, the difference in 
average puffs for the two laboratories can be ascribed to 
differences in speed of the smoking machines, differences 
in vacuum, difference in conditioning of the cigarettes 
and differences in laboratory humidity conditions. 


PM3001013714 
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If the independent listing by TITL as well as 
FTC is to serve any real purpose, it is important that the 
two laboratories 'be standardized insofar as possible. It 
is evident that some, if not all of the differences can 
be ascribed to" one or more,of the factors mentioned above 
and' largely arise from differences in TPM (IJiet) . 

To this end, it is suggested that if FTC cooperation 
can be secured, that: 

1. A careful check on the smoking machine 
operations be made on a comparative basis 
at both laboratories including machine 
speed and vacuum draw. 

2. Interchange tests be performed, on the 

. moisture content of samples of cigarettes 
prior to smoking as well as tests of ■ 
humidity conditions at the two laboratories. 

31 The present monitor cigarettes be changed 
to high TPM {Dry) type■cigarettes with 
such TPM (Dry) values in excess of'25 mgm 
per cigarette since those monitors V7ill be 
more sensitive'to differences. 

4. Continuing comparative analyses of all 
determinations including TPM (Wet), water 
content and nicotine be conducted for all 
tests in the future. 

\ 
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II- COMPARATIVE VARIABILITY IN DETBPMINATIONS 

It is not possible to establish which of the 
laboratories is more nearly correct in its nicotine and 
TPM determinations based on smoking machine operations, 
since'there is no standard to x^hich the result can be 
compared, but some measure of the quality of the labor¬ 
atory work can be gleaned from the available data. 

A measure of the quality of performance of a 
laboratory is the stability of repeated determinations from 
aliquots of a given material. The laboratory that produces 
more uniform {less variable) results for a given substance 
from which the aliquots were taken. 

However, in the case of nicotine and TPM (Dry) 
determinations based on smoked cigarettes,. the samples 
are not from a uniform well mixed solution, so that the 
variability of the determinations is also a function of 
the variability of the cigarettes tested. 


PM3001013716 
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A'comparative situation is obtained for the 
PTC laboratory and TITL results in the tests of monitor 
cigarettes where both laboratories are smoking from a 
batch of relatively uniform cigarettes. The comparative 
variability of the results, as measured by the standard 
deviation of the determinations should then be reflective 
of the comparative quality of the performance. 

However, the FTC laboratories follow the practice 

of discarding extreme or unusual,values. These discards 

are very numerous. The number of discards indicated on 

the FTC summary sheets by being crossed out or by being 

marked 'discarded* for tests 5 through 9 are shown below. 

Nicotine and TPM Determinations 
Discarded on FTC Summary Sheets 
Tests 5 Through 9 

Test Monitor Brand 

Number Cigarettes .Cigarettes Total 


5 77 

6 19 

7 94 

8 17 

9 158 


6 

139 

72 

91 

272 

366 

76 

93 

232 

390 


This count does not include figures omitted with¬ 
out explanation nor those discarded as lost or those listed 
on the detailed calculation sheets but not on the summaries, 
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Reportedly, the discards are the result of a 
statistical outlier test but since, in some cases, 
particularly in the monitor results, entire groups or 
runs are discarded, this statistical technique may not 
have been used in all situations. The desirability of 
this practice from a statistical viewpoint will be 
discussed later. I have been informed that the TITL 
does not follow the practice of eliminating extreme values 
but uses all results. 

As a result, the discards of .unusual values 
among the determinations should result in greatly lowered 
variability for FTC determinations since the remaining 
values should then be much more uniform than those of TITL. 
Hov/ever, this is not the case as may be seen in the compara¬ 
tive standard deviations of tar and nicotine determinations 
from uniform batches of monitor cigarettes used at both 
laboratories shown below. Again, it is to be noted that 

(s.) ■ ■ 

X was rnformed by telephone by Dr. Steel that 
the practice follovred at the FTC laboratory 'of discarding 
extremes is not used by TITL. _■ 
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since the same monitor cigarettes X'/ere not used at both 
laboratories for test 9, any comparison for that test 
is dubious. 

The variability of determinations for monitor 
cigarettes provide the best comparison betx^een the 
laboratories since they both used cigarettes from the 
same factory batch and the determinations were very numerous. 


Standard Deviation 

of TPM (Dry) and Nicotine Determinations 
of Monitor Cigarettes 


Standard Deviation* 


Test 


TPM 

(Dry) 

Nicotine 

Number 

• Date 

FTC 

TITL 

FTC. 

TITL 

5 

7/9/69 

,7473 

, 8049 

.0506 

.1047 

6 

11/19/69 

.7784 

,8972 

.0737 

.0527 

7 

5/18/70 

,9654 

.7490 

.0799 

,0519 

8 

10/21/71 

1,1734 

.7954 

.0615 

.0614 

9 

8/71 

.8612** .7536** 

.0547** 

.0612** 


*The standard deviations, are the overall standard- 
deviations for all determinations regardless of date 
performed. It measures the overall variability of 
the determinations. 

**These standard deviations cannot be compared betx^een 
'the laboratories since different monitor cigarettes 
were used at each laboratory. 
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The average standard deviation of the TPM (Dry) 
determinations for comparable tests (5 through 8) for 
FTC laboratory was .9161 while at TITL it was .8116. The 
average standard deviation for the-same four tests (5 
through 8) fox nicotine was •.■066.4-for the FTC laboratory 
and .0677 for TITL. These figures do. not reflect the 
much greater uniformity in PTC determinations that should 
be expected as a result of the extensive discards noted 
previously. Thus, there is an implication that the TITL 
determinations would show a much lower'variability than 
•those for the FTC, if such discards were not eliminated, 

III. PISCARDS 

The FTC practice^ of discar.ding unusual values, 
even if based on a statistical outlier test is of dubious 
validity. Outlier tests are of great value and elimination 
of the results are justified when a uniform sample is tested, 
as in aliguots of a well mixed solution. Thus if an outlier 
is determined by a statistical test among determinations 
for aliquots from a well mixed solution,- the discard of such 
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a value is justified on the basis that this is a reflec¬ 
tion of a'failure in the laboratory measurement techniques, 
or an error in recording such results. 

However, in testing cigarettes, the inherent 
variability of the cigarettes, ’even vzithin cigarettes 
from the same carton and much more so from different 
purchased cartons contained within the overall sample, 
is very great. 

Not only is there the variability induced by 
the inherently variable agricultural product (tobacco) 
but the innumerable variations in manfacture, as well as 
time to sale, cause great variations in the determinations. 
Thus older and more dried out cigarettes smoke faster. 

The cigarettes of necessity may vary considerably in weight 
reflecting differences in the amounts of tobacco in indi¬ 
vidual cigarettes. The diameters vary effecting smoking 
speed. Pinholes may occur in the cigarette paper, filters 
may vary, etc. 
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Thus it is to ba entirely expected.that 
individual unusual results may arise for determinations 
of TPM and nicotine which in no v/ay reflect variations 
in the measurements, but rather expected variations in 
the cigarettes. Since the consumer uses the cigarettes 
as received regardless of variation, there is no sound 
justification for discarding the resulting figures.’,. • 

This is especially true of brand cigarettes 
where only 20 determinations are. usually used for the 
average. Yet, in achieving these 20 values, in some 
instances as many as 5 or,6 determinations were dropped. 
This is an extremely dubious practice. 

It is suggested that the issue of the practice 
by the FTC laboratory of extensive elimination of values 
be raised as questionable. It is to be noted that even 
the large number of such discards shown in the table 
given previously do not reflect all the eliminated data 
but just those crossed out or marked discarded on the 
summary sheets. 


Source: https://www.industrydocuments.ucsf.edu/docs/nllk0001 
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IV. MONITOR CIGARETTES 

One of the most important protective features 
for the integrity of the data from both laboratories 
are the comparison between laboratories of the results 
for monitor cigarettes. These, if properly handled, 
represent a relatively well, mixed uniform sampling base, 

Ho^'jever, it - is to be noted that in the last 
test {No, 9) different monitors were used at the two 
laboratories. It is suggested that every effort be made 
to arrange for TITL to use the. same monitor cigarettes 
as the FTC laboratory and that great care be used to 
assure that they are well mixed and that a full comparison 
be made after each test. 


HAskoc 



Herbert Arkin 



PM3001013723 


Source: https://www.industrydocuments.ucsf.edu/docs/nllk0001 



